2026-09-30 16:46:53,488 [ 282143 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 16:46:53,488 [ 282143 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 16:46:53,488 [ 282143 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 16:46:53,488 [ 282143 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_k5x6ss --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_merge_tree_s3/test.py::test_alter_table_columns[node] test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_placement_info/test.py::test_placement_info_from_config test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_jdbc_bridge/test.py::test_jdbc_delete test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] test_max_authentication_methods_per_user/test.py::test_alter test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] test_partition/test.py::test_attach_check_all_parts [gw5] [ 1%] PASSED test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting [gw7] [ 2%] PASSED test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file [gw5] [ 3%] PASSED test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create [gw5] [ 4%] PASSED test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting [gw5] [ 5%] PASSED test_max_authentication_methods_per_user/test.py::test_create_default_setting [gw2] [ 6%] PASSED test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part [gw7] [ 7%] PASSED test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds [gw2] [ 8%] PASSED test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists [gw7] [ 9%] PASSED test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data [gw7] [ 10%] PASSED test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client [gw2] [ 11%] PASSED test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node [gw2] [ 12%] PASSED test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached [gw4] [ 13%] PASSED test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query [gw4] [ 14%] PASSED test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert [gw4] [ 15%] PASSED test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query [gw4] [ 16%] PASSED test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine [gw4] [ 17%] PASSED test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update [gw4] [ 18%] PASSED test_jdbc_bridge/test.py::test_jdbc_update [gw2] [ 19%] PASSED test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex [gw2] [ 20%] PASSED test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple [gw2] [ 21%] PASSED test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts [gw1] [ 22%] PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_jbod_ha/test.py::test_jbod_ha [gw2] [ 23%] PASSED test_partition/test.py::test_system_detached_parts test_keeper_availability_zone/test.py::test_get_availability_zone [gw8] [ 24%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where [gw8] [ 25%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where [gw3] [ 26%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] [gw8] [ 27%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree [gw3] [ 28%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] [gw8] [ 29%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree [gw1] [ 30%] PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication [gw5] [ 31%] PASSED test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 [gw5] [ 32%] PASSED test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client [gw5] [ 33%] PASSED test_postgresql_protocol/test.py::test_python_client [gw3] [ 34%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] [gw7] [ 35%] PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed [gw9] [ 36%] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted [gw7] [ 37%] PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed [gw1] [ 38%] PASSED test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart [gw3] [ 39%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] test_interserver_dns_retires/test.py::test_query [gw3] [ 40%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] [gw9] [ 41%] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error [gw9] [ 42%] SKIPPED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error [gw3] [ 43%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] [gw1] [ 44%] PASSED test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_keeper_secure_client/test.py::test_connection test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions [gw2] [ 45%] PASSED test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create [gw3] [ 46%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] [gw3] [ 47%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] [gw1] [ 48%] PASSED test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types [gw8] [ 49%] PASSED test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 [gw4] [ 50%] PASSED test_jbod_ha/test.py::test_jbod_ha [gw1] [ 51%] PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished [gw7] [ 52%] PASSED test_interserver_dns_retires/test.py::test_query test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw5] [ 53%] PASSED test_keeper_secure_client/test.py::test_connection [gw1] [ 54%] PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_log_levels_update/test.py::test_log_levels_update test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables [gw1] [ 55%] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables [gw2] [ 56%] PASSED test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_profiler/test.py::test_profiler [gw1] [ 57%] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries [gw4] [ 58%] PASSED test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_persistent_log_multinode/test.py::test_restart_multinode [gw1] [ 59%] PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases [gw1] [ 60%] PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 [gw8] [ 61%] PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw1] [ 62%] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 [gw5] [ 63%] PASSED test_log_levels_update/test.py::test_log_levels_update [gw1] [ 64%] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index [gw1] [ 65%] PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_library_bridge/test_exiled.py::test_bridge_dies_with_parent [gw1] [ 66%] PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished [gw7] [ 67%] PASSED test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading [gw4] [ 68%] PASSED test_keeper_persistent_log_multinode/test.py::test_restart_multinode [gw1] [ 69%] PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction [gw6] [ 70%] ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] [gw6] [ 71%] ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] [gw6] [ 72%] ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] [gw6] [ 73%] ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] [gw1] [ 74%] PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction [gw8] [ 75%] SKIPPED test_library_bridge/test_exiled.py::test_bridge_dies_with_parent [gw0] [ 76%] ERROR test_merge_tree_s3/test.py::test_alter_table_columns[node] test_merge_tree_s3/test.py::test_attach_detach_partition[node] [gw0] [ 77%] ERROR test_merge_tree_s3/test.py::test_attach_detach_partition[node] test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] [gw0] [ 78%] ERROR test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] [gw0] [ 79%] ERROR test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] test_merge_tree_s3/test.py::test_freeze_unfreeze[node] [gw0] [ 80%] ERROR test_merge_tree_s3/test.py::test_freeze_unfreeze[node] test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] [gw0] [ 81%] ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] [gw0] [ 82%] ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] [gw0] [ 83%] ERROR test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] [gw0] [ 84%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] [gw0] [ 85%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] [gw0] [ 86%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] [gw0] [ 87%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] [gw0] [ 88%] ERROR test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] [gw0] [ 89%] ERROR test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] [gw0] [ 90%] ERROR test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] [gw0] [ 91%] ERROR test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] [gw0] [ 92%] ERROR test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] [gw0] [ 93%] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] [gw0] [ 94%] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] [gw0] [ 95%] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] [gw0] [ 96%] ERROR test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] [gw0] [ 97%] ERROR test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] [gw0] [ 98%] ERROR test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] test_merge_tree_s3/test.py::test_table_manipulations[node] [gw0] [ 99%] ERROR test_merge_tree_s3/test.py::test_table_manipulations[node] [gw2] [100%] ERROR test_keeper_profiler/test.py::test_profiler ==================================== ERRORS ==================================== ___________ ERROR at setup of test_read_after_cache_is_wiped[0-4-2] ____________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:46:58 [ 554 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:58 [ 554 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:58 [ 554 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:46:58 [ 554 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:46:58 [ 554 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:46:58 [ 554 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:46:58 [ 554 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV HOSTNAME bde46ef906cc (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID f63969dd2c934707b6ca52abdda1ee4e (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PYTEST_XDIST_WORKER gw6 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : ENV PYTEST_CURRENT_TEST test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] (setup) (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:46:58 [ 554 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:46:58 [ 554 ] DEBUG : Cluster name: project_name:roottestmergetrees3withcache_gw6. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:46:58 [ 554 ] INFO : Starting cluster... (test.py:21, cluster) 2026-09-30 16:46:58 [ 554 ] INFO : Running tests in /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/test.py (cluster.py:2790, start) 2026-09-30 16:46:58 [ 554 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:46:59 [ 554 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:59 [ 554 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:59 [ 554 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:59 [ 554 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:59 [ 554 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:59 [ 554 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:59 [ 554 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:59 [ 554 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3withcache_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:59 [ 554 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:59 [ 554 ] DEBUG : No running containers for project: roottestmergetrees3withcache_gw6 (cluster.py:904, cleanup) 2026-09-30 16:46:59 [ 554 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:59 [ 554 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:59 [ 554 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:59 [ 554 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:59 [ 554 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:46:59 [ 554 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/configs/config.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/configs/config.d/query_log.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/database (cluster.py:4653, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:46:59 [ 554 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env (cluster.py:86, _create_env_file) 2026-09-30 16:46:59 [ 554 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:59 [ 554 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:59 [ 554 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:59 [ 554 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:59 [ 554 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:46:59 [ 554 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:02 [ 554 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:02 [ 554 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:03 [ 554 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:06 [ 554 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:49:06 [ 554 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:49:08 [ 554 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:49:57 [ 554 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:49:57 [ 554 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:01 [ 554 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:00 [ 554 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:51:00 [ 554 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:51:04 [ 554 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:52:02 [ 554 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:52:02 [ 554 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:52:02 [ 554 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:02 [ 554 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:02 [ 554 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:02 [ 554 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:02 [ 554 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3withcache_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : No running containers for project: roottestmergetrees3withcache_gw6 (cluster.py:904, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stdout:2 (cluster.py:121, run_and_check) 2026-09-30 16:52:02 [ 554 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:52:02 [ 554 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:52:02 [ 554 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:52:02 [ 554 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:52:02 [ 554 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3withcache_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : No running containers for project: roottestmergetrees3withcache_gw6 (cluster.py:904, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:52:02 [ 554 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:52:02 [ 554 ] DEBUG : Stdout:2 (cluster.py:121, run_and_check) __________ ERROR at setup of test_read_after_cache_is_wiped[8192-2-1] __________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________ ERROR at setup of test_write_is_cached[0-2] __________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_write_is_cached[8192-1] ________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_alter_table_columns[node] _______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:46:58 [ 506 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:58 [ 506 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:58 [ 506 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:46:58 [ 506 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:46:58 [ 506 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:46:58 [ 506 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:46:58 [ 506 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV HOSTNAME bde46ef906cc (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV WORKER_FREE_PORTS 30000 30001 30002 30003 30004 30005 30006 30007 30008 30009 30010 30011 30012 30013 30014 30015 30016 30017 30018 30019 30020 30021 30022 30023 30024 30025 30026 30027 30028 30029 30030 30031 30032 30033 30034 30035 30036 30037 30038 30039 30040 30041 30042 30043 30044 30045 30046 30047 30048 30049 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID f63969dd2c934707b6ca52abdda1ee4e (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PYTEST_XDIST_WORKER gw0 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : ENV PYTEST_CURRENT_TEST test_merge_tree_s3/test.py::test_alter_table_columns[node] (setup) (cluster.py:446, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:46:58 [ 506 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:46:58 [ 506 ] DEBUG : Cluster name: project_name:roottestmergetrees3_gw0. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:46:58 [ 506 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:46:58 [ 506 ] DEBUG : Cluster name: project_name:roottestmergetrees3_gw0. Added instance name:node_with_limited_disk tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:46:58 [ 506 ] INFO : Starting cluster... (test.py:49, cluster) 2026-09-30 16:46:58 [ 506 ] INFO : Running tests in /ClickHouse/tests/integration/test_merge_tree_s3/test.py (cluster.py:2790, start) 2026-09-30 16:46:58 [ 506 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:46:58 [ 506 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:59 [ 506 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:59 [ 506 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:59 [ 506 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:59 [ 506 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:59 [ 506 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:59 [ 506 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:59 [ 506 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:59 [ 506 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:59 [ 506 ] DEBUG : No running containers for project: roottestmergetrees3_gw0 (cluster.py:904, cleanup) 2026-09-30 16:46:59 [ 506 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:59 [ 506 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:59 [ 506 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:59 [ 506 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:59 [ 506 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:46:59 [ 506 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/bg_processing_pool_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/blob_log.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/database (cluster.py:4653, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Setup directory for instance: node_with_limited_disk (cluster.py:2810, start) 2026-09-30 16:46:59 [ 506 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/bg_processing_pool_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/blob_log.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/database (cluster.py:4653, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/logs (cluster.py:4664, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:46:59 [ 506 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env (cluster.py:86, _create_env_file) 2026-09-30 16:46:59 [ 506 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:59 [ 506 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:59 [ 506 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:46:59 [ 506 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:46:59 [ 506 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:46:59 [ 506 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:34 [ 506 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:34 [ 506 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:36 [ 506 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:08 [ 506 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:08 [ 506 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling resolver ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node_with_limited_disk ... done Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:50:10 [ 506 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:51:31 [ 506 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:51:31 [ 506 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node_with_limited_disk ... Pulling resolver ... pulling from altinityinfra/python... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:51:34 [ 506 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:18 [ 506 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:53:18 [ 506 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node_with_limited_disk ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:53:23 [ 506 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:55:07 [ 506 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:55:07 [ 506 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:55:07 [ 506 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:55:07 [ 506 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:55:07 [ 506 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:55:07 [ 506 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:55:07 [ 506 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : No running containers for project: roottestmergetrees3_gw0 (cluster.py:904, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:55:07 [ 506 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:55:07 [ 506 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:55:07 [ 506 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:55:07 [ 506 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:55:07 [ 506 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : No running containers for project: roottestmergetrees3_gw0 (cluster.py:904, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:55:07 [ 506 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:55:07 [ 506 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _____________ ERROR at setup of test_attach_detach_partition[node] _____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __ ERROR at setup of test_cache_with_full_disk_space[node_with_limited_disk] ___ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_freeze_system_unfreeze[node] ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________ ERROR at setup of test_freeze_unfreeze[node] _________________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_insert_same_partition_and_merge[False-node] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_insert_same_partition_and_merge[True-node] _______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_lazy_seek_optimization_for_async_read[node] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_merge_canceled_by_drop[node] ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_merge_canceled_by_s3_errors[node-broken_s3] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_merge_canceled_by_s3_errors_when_move[node] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_move_partition_to_another_disk[node] __________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_move_replace_partition_to_another_table[node] _____ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_disk_apply_new_settings[node] ____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_s3_disk_heavy_write_check_mem[node] __________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_s3_disk_reads_on_unstable_connection[node] _______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_no_delete_objects[node] _______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____________ ERROR at setup of test_simple_insert_select[0-16-node] ____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_simple_insert_select[8192-12-node] ___________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_table_manipulations[node] _______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________________ ERROR at setup of test_profiler ________________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def started_cluster(): try: > cluster.start() test_keeper_profiler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling node1 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node3 ... E Pulling resolver ... E Pulling node2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node3 ... pulling from altinityinfra/integr... E Pulling node3 ... digest: sha256:2ea9da862c215fd684... E Pulling node3 ... status: image is up to date for a... E Pulling node3 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling node1 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling resolver ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:50:38 [ 512 ] INFO : Running tests in /ClickHouse/tests/integration/test_keeper_profiler/test.py (cluster.py:2790, start) 2026-09-30 16:50:38 [ 512 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:50:38 [ 512 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:50:38 [ 512 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:50:38 [ 512 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:50:38 [ 512 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:50:38 [ 512 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:50:38 [ 512 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:50:38 [ 512 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:50:38 [ 512 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperprofiler_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:50:38 [ 512 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:50:38 [ 512 ] DEBUG : No running containers for project: roottestkeeperprofiler_gw2 (cluster.py:904, cleanup) 2026-09-30 16:50:38 [ 512 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:50:38 [ 512 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:50:38 [ 512 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:50:38 [ 512 ] DEBUG : Stdout:2 (cluster.py:121, run_and_check) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:50:38 [ 512 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_profiler/configs/keeper_config1.xml'] to /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup directory for instance: node2 (cluster.py:2810, start) 2026-09-30 16:50:38 [ 512 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_profiler/configs/keeper_config2.xml'] to /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/database (cluster.py:4653, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/logs (cluster.py:4664, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup directory for instance: node3 (cluster.py:2810, start) 2026-09-30 16:50:38 [ 512 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_profiler/configs/keeper_config3.xml'] to /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/database (cluster.py:4653, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/logs (cluster.py:4664, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:50:38 [ 512 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env (cluster.py:86, _create_env_file) 2026-09-30 16:50:38 [ 512 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:50:38 [ 512 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:50:38 [ 512 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:50:38 [ 512 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:50:38 [ 512 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:50:38 [ 512 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:51:06 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:51:07 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:51:37 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:51:37 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:52:07 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:52:08 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:52:13 [ 512 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:52:13 [ 512 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling node1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node3 ... pulling from altinityinfra/integr... Pulling node2 ... done Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:52:15 [ 512 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:52:38 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:52:40 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:53:10 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:53:15 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:53:45 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:53:51 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:53:54 [ 512 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:53:54 [ 512 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling node1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:53:56 [ 512 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:54:21 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:54:37 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:55:08 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:55:28 [ 512 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:55:28 [ 512 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling node1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node3 ... Pulling node2 ... pulling from altinityinfra/integr... Pulling node3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node3 ... done Pulling node1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:55:30 [ 512 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:55:33 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:56:03 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:56:34 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:57:04 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:57:14 [ 512 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:57:14 [ 512 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling node1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling resolver ... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:57:18 [ 512 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:58:15 [ 512 ] INFO : Connecting to 172.16.16.4(172.16.16.4):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:58:45 [ 512 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:59:02 [ 512 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling node1 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling resolver ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:59:02 [ 512 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:59:02 [ 512 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:59:02 [ 512 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:59:02 [ 512 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:59:02 [ 512 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:59:02 [ 512 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:59:02 [ 512 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperprofiler_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:59:02 [ 512 ] DEBUG : No running containers for project: roottestkeeperprofiler_gw2 (cluster.py:904, cleanup) 2026-09-30 16:59:02 [ 512 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:59:02 [ 512 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:59:02 [ 512 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:59:02 [ 512 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:59:02 [ 512 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:59:02 [ 512 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:59:02 [ 512 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:59:02 [ 512 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:59:03 [ 512 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:59:03 [ 512 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperprofiler_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:59:03 [ 512 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:59:03 [ 512 ] DEBUG : No running containers for project: roottestkeeperprofiler_gw2 (cluster.py:904, cleanup) 2026-09-30 16:59:03 [ 512 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:59:03 [ 512 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:59:03 [ 512 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:59:03 [ 512 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) =============================== warnings summary =============================== test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-38 (attack) Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py", line 431, in attack cursor.execute(query_pool[query_id].format(random_table_name)) psycopg2.errors.NumericValueOutOfRange: integer out of range warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 504.94s setup test_keeper_profiler/test.py::test_profiler 488.63s setup test_merge_tree_s3/test.py::test_alter_table_columns[node] 304.01s setup test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 106.90s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 105.71s setup test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 104.62s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 95.95s setup test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading 58.91s setup test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication 58.77s setup test_jdbc_bridge/test.py::test_jdbc_delete 58.02s setup test_postgresql_protocol/test.py::test_java_client 57.52s setup test_placement_info/test.py::test_placement_info_from_config 57.43s setup test_keeper_memory_soft_limit/test.py::test_soft_limit_create 57.34s setup test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node 56.86s setup test_partition/test.py::test_attach_check_all_parts 55.72s setup test_max_authentication_methods_per_user/test.py::test_alter 54.85s setup test_log_levels_update/test.py::test_log_levels_update 52.44s call test_interserver_dns_retires/test.py::test_query 51.17s setup test_jbod_ha/test.py::test_jbod_ha 49.37s setup test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 49.04s setup test_keeper_and_access_storage/test.py::test_create_replicated 47.71s setup test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 47.66s setup test_keeper_secure_client/test.py::test_connection 44.60s setup test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 44.41s setup test_keeper_availability_zone/test.py::test_get_availability_zone 39.54s setup test_keeper_persistent_log_multinode/test.py::test_restart_multinode 38.12s call test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication 33.92s call test_jbod_ha/test.py::test_jbod_ha 25.62s call test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions 22.98s call test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication 22.44s teardown test_jdbc_bridge/test.py::test_jdbc_update 22.41s teardown test_postgresql_protocol/test.py::test_python_client 21.77s call test_keeper_persistent_log_multinode/test.py::test_restart_multinode 19.58s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 19.37s call test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 17.59s call test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 17.35s call test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart 17.05s call test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 16.77s call test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 15.54s call test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 15.31s teardown test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 15.20s teardown test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 15.03s call test_partition/test.py::test_system_detached_parts 14.85s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 14.38s call test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 12.78s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 11.16s teardown test_keeper_memory_soft_limit/test.py::test_soft_limit_create 10.68s call test_jdbc_bridge/test.py::test_jdbc_delete 9.43s teardown test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading 9.42s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 8.85s call test_postgresql_replica_database_engine_1/test.py::test_single_transaction 8.16s call test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading 7.66s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 7.07s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 7.03s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 6.71s call test_postgresql_replica_database_engine_1/test.py::test_different_data_types 6.66s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 6.47s teardown test_jbod_ha/test.py::test_jbod_ha 6.35s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 6.17s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 6.11s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 6.01s teardown test_log_levels_update/test.py::test_log_levels_update 5.98s teardown test_partition/test.py::test_system_detached_parts 5.92s teardown test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed 5.91s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 5.64s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 5.36s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 5.34s call test_partition/test.py::test_make_clone_in_detached 5.13s teardown test_keeper_secure_client/test.py::test_connection 4.80s teardown test_max_authentication_methods_per_user/test.py::test_create_default_setting 4.71s call test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 4.15s teardown test_placement_info/test.py::test_placement_info_missing_data 3.97s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 3.97s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 3.56s call test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value 3.46s teardown test_keeper_availability_zone/test.py::test_get_availability_zone 3.42s call test_log_levels_update/test.py::test_log_levels_update 3.24s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 3.17s call test_partition/test.py::test_detached_part_dir_exists 3.01s teardown test_postgresql_replica_database_engine_1/test.py::test_single_transaction 3.01s call test_partition/test.py::test_drop_detached_parts 2.90s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 2.70s call test_placement_info/test.py::test_placement_info_from_file 2.70s call test_placement_info/test.py::test_placement_info_from_imds 2.68s call test_partition/test.py::test_attach_check_all_parts 2.66s call test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 2.62s teardown test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions 2.48s teardown test_keeper_persistent_log_multinode/test.py::test_restart_multinode 2.45s call test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 2.40s call test_partition/test.py::test_partition_complex 2.17s teardown test_keeper_and_access_storage/test.py::test_create_replicated 2.14s teardown test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication 1.93s teardown test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 1.58s call test_postgresql_replica_database_engine_1/test.py::test_quoting_2 1.56s teardown test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 1.50s call test_postgresql_replica_database_engine_1/test.py::test_quoting_1 1.45s teardown test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication 1.42s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_2 1.34s call test_max_authentication_methods_per_user/test.py::test_alter_default_setting 1.32s setup test_partition/test.py::test_drop_detached_parts 1.19s call test_max_authentication_methods_per_user/test.py::test_alter 1.17s teardown test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 1.10s teardown test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 1.08s setup test_partition/test.py::test_system_detached_parts 1.07s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 1.02s setup test_partition/test.py::test_partition_simple 1.01s teardown test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart 0.97s teardown test_postgresql_replica_database_engine_1/test.py::test_different_data_types 0.95s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.94s teardown test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.93s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 0.91s teardown test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.82s teardown test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.81s setup test_partition/test.py::test_partition_complex 0.80s call test_jdbc_bridge/test.py::test_jdbc_insert 0.76s teardown test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value 0.75s call test_jdbc_bridge/test.py::test_jdbc_update 0.72s call test_postgresql_protocol/test.py::test_java_client 0.70s call test_partition/test.py::test_cannot_attach_active_part 0.69s call test_postgresql_protocol/test.py::test_psql_client 0.67s call test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node 0.66s call test_placement_info/test.py::test_placement_info_from_config 0.66s setup test_partition/test.py::test_cannot_attach_active_part 0.65s call test_max_authentication_methods_per_user/test.py::test_create_default_setting 0.60s call test_partition/test.py::test_partition_simple 0.60s call test_max_authentication_methods_per_user/test.py::test_create 0.58s call test_jdbc_bridge/test.py::test_jdbc_table_engine 0.58s call test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed 0.54s call test_placement_info/test.py::test_placement_info_missing_data 0.53s call test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 0.43s teardown test_partition/test.py::test_drop_detached_parts 0.42s call test_keeper_availability_zone/test.py::test_get_availability_zone 0.38s teardown test_partition/test.py::test_attach_check_all_parts 0.37s call test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.32s call test_keeper_memory_soft_limit/test.py::test_soft_limit_create 0.32s call test_jdbc_bridge/test.py::test_jdbc_query 0.27s call test_keeper_secure_client/test.py::test_connection 0.22s teardown test_partition/test.py::test_partition_complex 0.22s call test_keeper_and_access_storage/test.py::test_create_replicated 0.22s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 0.17s teardown test_partition/test.py::test_cannot_attach_active_part 0.17s teardown test_partition/test.py::test_partition_simple 0.08s call test_postgresql_protocol/test.py::test_python_client 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions 0.00s setup test_interserver_dns_retires/test.py::test_query 0.00s teardown test_merge_tree_s3/test.py::test_table_manipulations[node] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.00s teardown test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.00s teardown test_interserver_dns_retires/test.py::test_query 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication 0.00s setup test_partition/test.py::test_make_clone_in_detached 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.00s teardown test_partition/test.py::test_make_clone_in_detached 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.00s setup test_max_authentication_methods_per_user/test.py::test_alter_default_setting 0.00s teardown test_keeper_profiler/test.py::test_profiler 0.00s setup test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.00s teardown test_max_authentication_methods_per_user/test.py::test_alter 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 0.00s setup test_max_authentication_methods_per_user/test.py::test_create_default_setting 0.00s setup test_jdbc_bridge/test.py::test_jdbc_query 0.00s setup test_partition/test.py::test_detached_part_dir_exists 0.00s setup test_jdbc_bridge/test.py::test_jdbc_table_engine 0.00s setup test_jdbc_bridge/test.py::test_jdbc_insert 0.00s setup test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_delete 0.00s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 0.00s setup test_jdbc_bridge/test.py::test_jdbc_update 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 0.00s setup test_placement_info/test.py::test_placement_info_from_imds 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_different_data_types 0.00s teardown test_max_authentication_methods_per_user/test.py::test_create 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 0.00s teardown test_placement_info/test.py::test_placement_info_from_file 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 0.00s teardown test_merge_tree_s3/test.py::test_alter_table_columns[node] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_single_transaction 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_query 0.00s teardown test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] 0.00s teardown test_partition/test.py::test_detached_part_dir_exists 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value 0.00s setup test_postgresql_protocol/test.py::test_python_client 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_insert 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 0.00s teardown test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 0.00s setup test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] 0.00s teardown test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] 0.00s teardown test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] 0.00s teardown test_postgresql_protocol/test.py::test_java_client 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 0.00s teardown test_merge_tree_s3/test.py::test_attach_detach_partition[node] 0.00s teardown test_placement_info/test.py::test_placement_info_from_config 0.00s teardown test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] 0.00s teardown test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] 0.00s teardown test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] 0.00s setup test_placement_info/test.py::test_placement_info_from_file 0.00s teardown test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] 0.00s setup test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] 0.00s teardown test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 0.00s teardown test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 0.00s teardown test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] 0.00s teardown test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] 0.00s teardown test_merge_tree_s3/test.py::test_freeze_unfreeze[node] 0.00s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 0.00s setup test_max_authentication_methods_per_user/test.py::test_create 0.00s teardown test_postgresql_protocol/test.py::test_psql_client 0.00s setup test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] 0.00s setup test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 0.00s teardown test_placement_info/test.py::test_placement_info_from_imds 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 0.00s setup test_merge_tree_s3/test.py::test_attach_detach_partition[node] 0.00s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 0.00s setup test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 0.00s setup test_placement_info/test.py::test_placement_info_missing_data 0.00s setup test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] 0.00s setup test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] 0.00s setup test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] 0.00s setup test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] 0.00s setup test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] 0.00s setup test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 0.00s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 0.00s setup test_postgresql_protocol/test.py::test_psql_client 0.00s setup test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] 0.00s setup test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] 0.00s setup test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] 0.00s setup test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] 0.00s setup test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] 0.00s setup test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] 0.00s setup test_merge_tree_s3/test.py::test_table_manipulations[node] 0.00s setup test_merge_tree_s3/test.py::test_freeze_unfreeze[node] 0.00s setup test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] 0.00s setup test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 0.00s teardown test_max_authentication_methods_per_user/test.py::test_alter_default_setting 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_table_engine 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where =========================== short test summary info ============================ ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_alter_table_columns[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_attach_detach_partition[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] ERROR test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_freeze_unfreeze[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] ERROR test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] ERROR test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] ERROR test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] ERROR test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] ERROR test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_table_manipulations[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_keeper_profiler/test.py::test_profiler - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/.env', '--project-name', 'roottestkeeperprofiler_gw2', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw2/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... PASSED test_max_authentication_methods_per_user/test.py::test_alter PASSED test_placement_info/test.py::test_placement_info_from_config PASSED test_max_authentication_methods_per_user/test.py::test_alter_default_setting PASSED test_max_authentication_methods_per_user/test.py::test_create PASSED test_max_authentication_methods_per_user/test.py::test_create_default_setting PASSED test_partition/test.py::test_attach_check_all_parts PASSED test_placement_info/test.py::test_placement_info_from_file PASSED test_partition/test.py::test_cannot_attach_active_part PASSED test_placement_info/test.py::test_placement_info_from_imds PASSED test_placement_info/test.py::test_placement_info_missing_data PASSED test_partition/test.py::test_detached_part_dir_exists PASSED test_partition/test.py::test_drop_detached_parts PASSED test_jdbc_bridge/test.py::test_jdbc_delete PASSED test_jdbc_bridge/test.py::test_jdbc_distributed_query PASSED test_jdbc_bridge/test.py::test_jdbc_insert PASSED test_jdbc_bridge/test.py::test_jdbc_query PASSED test_jdbc_bridge/test.py::test_jdbc_table_engine PASSED test_jdbc_bridge/test.py::test_jdbc_update PASSED test_partition/test.py::test_make_clone_in_detached PASSED test_partition/test.py::test_partition_complex PASSED test_partition/test.py::test_partition_simple PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication PASSED test_partition/test.py::test_system_detached_parts PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication PASSED test_postgresql_protocol/test.py::test_java_client PASSED test_postgresql_protocol/test.py::test_psql_client PASSED test_postgresql_protocol/test.py::test_python_client PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed PASSED test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] PASSED test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart PASSED test_keeper_availability_zone/test.py::test_get_availability_zone PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] PASSED test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions PASSED test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 PASSED test_jbod_ha/test.py::test_jbod_ha PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types PASSED test_interserver_dns_retires/test.py::test_query PASSED test_keeper_secure_client/test.py::test_connection PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables PASSED test_keeper_memory_soft_limit/test.py::test_soft_limit_create PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables PASSED test_keeper_and_access_storage/test.py::test_create_replicated PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 PASSED test_log_levels_update/test.py::test_log_levels_update PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml PASSED test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading PASSED test_keeper_persistent_log_multinode/test.py::test_restart_multinode PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction SKIPPED [1] test_merge_tree_load_parts/test.py:227: Skip with debug build and sanitizers. This test intentionally triggers LOGICAL_ERROR which leads to crash with those builds SKIPPED [1] test_library_bridge/test_exiled.py:53: Leak sanitizer falsely reports about a leak of 16 bytes in clickhouse-odbc-bridge ======= 69 passed, 2 skipped, 1 warning, 29 errors in 726.02s (0:12:06) ======== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_k5x6ss --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.